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ABSTEACT 

This report is an evaluation of a New York City 
school diatrict educational project funded under Title Til of the 
Elementary and Secondary Education let of 1965, The goals of the 
program were to provide bilingual instructional aer vices in all 
subject areas to Hispanic pupils of limited English-speaking ability 
and to select^ train^ and place bilingual teachers in the classroom* 
Approximately 2400 Hispanic children in grades K^8 were served by the 
program* Eighty college graduates with teaching credentials and 
bilingual communication skills in English and Spanish served as 
interns in the instructional program. The interns were placed in 54 
schools encompassing three New York City boroughs. The program was 
staffed by a Project Director^ a Coordinator^ three 
Field/Counaelors/Teacher Trainers^ and two administrative aides. 
Teacher training was conducted through three components^ in-service 
workshops^ graduate school training, and field supervision, specific 
program objectives and the means for achieving theac objectives are 
outlined. The findings are presented and discussed. On the basis of 
the results it was concluded that the major objectives were met, 
(Author/BS) 
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CHAPTER I 
THE PROGRAM 



^ " Qgganlaatl on and Imp iamentatlon 

The BlU„gu,l T«char Intern P.ogra,^ funded under ESEA Title VII 
»a« . ce„t„ll, based progra. operating under the Jurisdiction of .J 
omce of Bilingual Education, Ke„ York City Board of Education. In l„3-;6 
eleven decentralized Co^unlt, School districts participated In the pro,ra„ 
Participation „as based on arrangement and assurances between C.S D 's 
and the progra™ in compliance .1th the progra. funding guidelines and 
objectives* 

The major goal of the progra. „a to provld. bilingual instructional 

-rvices to Hispanic pupils of limited English-speaUng ability. , cor- 
ollary goal was to select, train and place bilingual teachers in the 

claaaroora, 

lo accomplish this goal, the progra. selected 80 college graduates 
""h teaching credentials and bilingual communication skills in English 
and Spanish. Each of these Interns was placed in an instructional program 
that included full time responsibilities a, classroom teacher,. The interns 
"=re Placed in 54 schools spread over a geographical area that encompassed 
U C.S.D..S m 3 boroughs - the Bronx, Manhattan and Brooklyn. The partici- 
pating districts ware 3, 4, 7, 8. 9, 10. 12, is, 17, 19, and 32. 

The program served approximately 2400 Hispanic children of limited 
English-speaking ability, in grades K - 8 by providing bilingual instruction 
m all subject areas. In addition, pupils received instruction in English 

as a Second Language, Spanish language skills and Hf.r,„j \, 

^ BKiiAs, and Hlapanle hlstaxy and 

culture. 
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The program was staffed by a Coordinator, three Field Caunselors/Teaeher 
Tralneri and t%^o adminiitratlve aides all under cha supervision of a Project 

Director * 

Teachar Training was conducted through three separate components i 
in-service workshopa, graduate school training at the City University of 
New York (Ct^) and field supervision conducted by the trainers. The field 
supervision included periodic observations at each site location. 

The prograin staff provided opportunity for parental involvement by creat- 
ing workahopa in various aspects of bilingual education in conjunction with 
cooperating C.S.D.'s. Through the supervision of the Teacher Trainers, second 
language instruction workshops ^ere developed for the parents of target pupils 
in three districts (3, 9, 19)* Parent Advisory Cotnmittees ^ere formed in 
several districts* In addition the program foraad an Intern Advisory Council 
composed of Bilingual Intern representatives from each participating district* 

Dissemination of the program's activities was accomplished in a variety 
of ways. The program published the Bilingual Newsletter in the Spring, 1976, 

In January, 1976 s the program participated in the Regional Cross-Cultural 
Training and Resource Center's Bllingual/Bicul tural >toterials Conference at 
Fordhao University, The program Staff and Bilingual Teacher Interns partici- 
pating in the conference, conducted Bilingual/Bicultural demonstration lessons 
in reading, mathematics ^ science, creative writing in Spanish language arts, 
English as a Second Language ^ integration of Puerto Rican History and Culture 
through creative and educational activities* In addition the Interns exhibit- 
ed creative teacher-made instructional materials which they have made and have 
used in the classroom* 

Additionally, the PrDject provided special workshops to other Bilingual 
Staff members in COTOiunity School Districts -3, 9, 17, and 19» Planning for future 
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workshops was Initiated with Cooffliuntty School Districts 4, 15 and 32. 
Instructional and Tratnlng Activities 

Fuptls I The thrust of tlia pupil Instructional Gomponent of this prograni was to 
develop reading and raatheaatlcs skills by providing small group and Individual- 
ized instruction In the pupil's dominant language. To prevent separation of 
the children solely by language or ethnic background, all Ins tructional activitiei 
In the second culture, art, music, physical education and other interrelated 
school activities were coordinated with the English-speaking non-target popula- 
tion. Targeted pupils received the following instructional acttvltles on a 
dally basts: 

Second C^ilture and culture patterns, differences 
and similarities ' . , ' . \ ^ - 

Oral English as a Second Language and other English 
linguistic skills (reading and writing) dependtng on 
the Individual pupil -s progress 

Major subject areas In the dominant language 

Puerto Rican and Hispanic History and Culture 

Reinforcement of positive cultural Identity, self -^concepts 
and self-pride 

Spanish reading and language arts 
Interns : Field Counseling Component- The three Field Service Counselors/ 
Teacher Trainers provided the Bilingual Teacher Interns with essential on^ 
the-job training working In cooperation with the CoTOuntty School Dl.^tricts as 
supervisory and resource persons. Trainers assisted the Interns In conduct* 
Ing Instructional atttvitles for maKimum services. Trainers provided the 
following activities under this component* 

* Assisted in classroom procedures and management 

» Assisted in dtagnoslng language dominance and other academic skills 

, Assisted In administering pretests and postteste In reading and mathema- 
tics for evaluation 7 



, Assisted in all Ini tructional activiciei by providing 
deTOnstratlDn lessons, observations and counseling 

• Assisced in the development and creation of maCerial& 
for curriculum resources * 

Trainers completed weekly projeccion charts and made periodic school 
visits to each Bilingual Teacher Intern under their supervision* Each 
'^achar 'trainer was assigned 26 or 27 Bilingual Teacher Interns* In add- 
ition '£aachar 'trainers completed weekly ^ogress xeports detailing the 
progress and problems of each Intern visited. Also detailed were tn^ 
dividual conferences with Internsj School Mffllnistratlon (Principal^ Bi- 
lingual Coordinators) 5 parent and conanunity groups. The instructional 
program presented by each intern was highlighted to include the strengths 
and weaknesses .needs and growths of the pupils, Tht 'progress report de- 
veloped for each intern served to provide feed-back at tha program's weekly 
staff meetings* 

In Service Workshop Component i The program's Pre-Service Teacher Training 
Workshop for the Bilingual Teacher Interns started in March ^ 1975 prior to 
actual program funding. Within the workshops , the Bilingual Teacher Interns 
participated in preparation activities and administrative tasks to ready 
them f c r the classroom* The program succe^ssfully conducted an intensive 

3 day Fre-Service Planning Session Workshop in September, 1975* The Appendix 
details the activities. 

Ia*s^rvice workshops were conducted by the Project Dirrifttor and Coordin- 
ator assisted by the three Field Counselors/Teachgr Trainers throughout the 
duration of the school year. Each weekj for two hourSi interns attended 
these workshops. Training consisted of activities designed to provide the 
following skills: 

. MeChodologles and strategies in planning for effective 
Bilingual/Bicultural learning situations* 
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, Ciassroom oparaCion and mana|,ement* 

. UndersCandlng language aequlscion* 

• Assessing and diagnosing language* 

« Diagnoi tng^ skllli and grouping of pupils, 

• Lesson planning, nodular and unit planning,- 

• Saeond language learning and asseisement* 

• Exploring curriculum and Instructional activltiea 
in all currleulm areas available through existing 
CQmmarcially published material in Spanish* 

. The making and use of creative and innovative teacher^ 
made materials, 

, The reading process: methods, techniques and skills* 

• Use of the paraprDfesslonal in the classroom* 
, Coordination of parent -conmunlty ^rkshops. 

• Sessions at the Ragional|; CrosS'^Cultural Training and 
Resource Center. 1 

As part of the training workshops , the project employed guest speakers 
and participated in experimental vorkshopi, such as the N,Y,U,, School of 
Educatidnp Science Departnient Progrm "Project City SciencaV 

Much of the Spring semester's workshop was structured around a series 

of modules integrating the use of audio-visual hardware and creative teache: 

made materials tijlth various curricular areas. Modules were assigned each 

trainer in accordance with their subject expertise* Three separate groups 

of interns were eKposed to each module on a rotating basis throughout the 

duration of thm Spring semester* Some of the instructional modules werei 

. Language Arts and Social Studies in the bilingual 
classroom, 

. Mathematics In the bilingual classroom, 

• Science In the bilingual classroom, 

p Puerto Rtcan and Hispanic History and Culture 
in the classroom* 



. CraaCivlty, visual and dramacic arcs in the classroom. 

• Intreduotion to Wdio^Vlsual mater lalsi utilization 
and operation of hardi^are and ioftvare. The making .of 
iimple software, 

• Reinforcemant of Language acquisition in Spanish and 
English. 

In addition to the regular planned training sassioni in Bilingual/Bi* 
Qultural materials and learaing aetivities, the program provided selected 
guest speakers and workshops in saniitivity training,, learning diaabilitiea, 
rhythm and toovement far young children and Domlnioan Culture. 
Graduate So hool Training Camponant - All 80 teacher interns were matrieulated 
in a Masters degrsa Progr^ in Bilingual Sdueatton at the City Univeriity of 
New York (CUOT) , During the Fall samester, 1975, each intern earned si^c 
graduate credit The courses completed werei 

• Teaching Practicum in Bilingual Sduoatlon 

. Teaahing Reading in Spanish to Bilingual/Bieultural Children.. 

The Practicum provided mini - wrkihops in teaching reading, mathematics 
iocial studies and science to bilingual/bicultural students* It also exposed 
the intarns to a variety of bilingual curriculum materiali and the criteria 
and techniquea to appropriately evaluate th^* A noteworthy feature of the 
practictm was the provision for integration with the CUKY Workihop in Open 
Education, Each intarn participatad in two or three of thaaa open education 
workshops. Articulation with the Bilingual Program and the interns^ classroom 
experience was provided chrough field supervision conducted by the project's 
three teacher trainers* 

The course in taaching reading in Spanish stressed the reading process 
and skills devalopment necessary to teach reading at any age level. Methods 
were provided to teach these skills in Spanish reading to both Spanish 
dotninantt and English dominant children. 
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All graduate school Instructors coordinated anc worked closely with the 
project staff. Teacher trainers ofaserved numerous graduate school classes; 
graduate school instructDrs participated in the program's weekly fn-Sflrvice 
Workshops 

During the Spring, 1976, each intern earned an additional three graduat< 
credits by completing one of the following courses at CMWf^ 
. Teaching English as a Second Language* 
. The Vernacular Language of Puerto Rico, 

^ Frograrg Objectives 

Under the broad goal of providing bilingual instruction services to 
Hispanic pupils of limited English speaking ability, the program had the 
following finabllng and terminal objectives: 

1. Pupils - To provide instructional activities to enable pupils to 
achieve significant Improvement in each of the following areas i 

* oral ' aural fluency in Spanish and English * 
. reading comprehension In Spanish. 

* knowledge and appreciation of Hispanic history and culture. 

. knowledge and appreciation of the second culture and Its 
dlversi ty - 

^ Self-esteem through positive cultural Identity and self-pride* 

2- Bilingual Teacher Interns - To enhance achievement of pupil objectives, 
the program had the complementaiy .objective i To train 80 new Spanish 
speaking college graduates in the techniques of bilingual education to 
become regularly licensed and appointed Bilingual Comon Branch teachers 
after one academic school year* 

3* Parents - To enhance achievement of pupil objectives, the program had 
Che complementary objective.* To recruit and train the parents of the 
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HlspaniG pupils targeCed to enable them to i 

cooperate with the school in providing reinforcement 
of dasired pupil behaviori • 

uridersCand the purpose of Bilingual/Biculcural Education, 
underitand the implementation of the ASPI^ Consent Deere 
improve their coccmunication skills in English laniuage. 
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CHM»T1R II 
EVM.UATION PROClDiraiS 

jvEluatlen Objastlve #1: 

It Is expected that the mean, poittest score aehieved by the treatmsnC 
graup will surpass their pretesr seore at the *0S level or statlitleal 
slgnlfiQanee ^han resulta of the Cooperative Intar-American Series Reading 
Comprehension Test are submitted to analyaii. 

1,1 Sabjeat s! The treatment group will consisc of all Title VII pupils 

raceiving bilingiial reading instruation* 
1*2 Methoda and Procedurea ; The Vooabulai^ and Reading Coiaprehenaion 

(Fruebas de Laotura) Teata of^ Inter'Amerioan Series fHll be administer 
ed to all subjeata on a pre^posc basis, Bie Project Director will 
aasemble the results of each test administration in the format 
specified hy the evaluator to expedite a proper analysis of the data 
Data Analysis : Reaults will be analysed with the "Pretest/ Posttaat 
(without controla)" design* The diffarenca between raw score means 
will be tasted for statistical significance at the ,05 level with 
a correlated t^ test, 
lt4 Time Schedule r PraC.^^t administration - November, 197S 

Poattest aftainistration - Mayj 1976 

Evaluation Obi active #2f 

It is expected that the maan post-test reading score achieved by the 
treatment group will surpass their pretest score at the ,05 laval of sta^ 
tistical significance when results of the Cooperative Inter-AmariQan Series 
in tothematics are submitted to analysis with a t^ test for correlated groups 
2,1 Subjects t The treatment group will consist of all Title VII pupils. 

raceiving bilingual inftruction in mathematics. 
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2-2 Methods and Proeedures i All iubjects will be adminlgcered the 

approprlmte lavel of the Tait af General Ability, Nimerlcal flueney 
subteit or thm Teat of Reading and Nmbar (Incer -American Series) 
In chair dominant language on a pre-p.^attesc baaia. The Erojeet 
Birectar will asaerable the reaulta of eaah test administration In 
the format specified hj the evaluator to expedlta a proper analysis 
af the data. 

2 -3 Data Analysis ; Rasults will be analysed with the "Pretest^Posttest 
(without controls)" design* The difference between raw score means 
will be tested for statistical signiflcanca at £he .05 level with a 
correlated £ teat, 

2*4 Time Schedule - Fr&test administration - October, 1975 

Postcest^ administration - May^ ; 976 

Evaluation Ob1ec£lve #3: 

It is eKpected that at least two thirds of the b,; lingual Interns 
will provide favorable ef feoclveness ratings on more than 60 percent of 
rating sdale Indices concerning quality of training. 

3.1 Subjects : All Bilingual Teacher Interns receiving all three components 
of the training program, 

3*2 Methods and Procedures g A multi-item rating scale consisting of 

objective and open-ended Items tailored specifically to program train- 
ing objectives will be developed by the evaluator in consultation with 
the project director. This instrtment will be administered to all 
Interns in June^ 1976-1977. 

3*3 Data Analysis ! Results of Interns' ratings of training effectiveness 
will be analyzed and presented in both tabular and narrative form. 
The percentage of Interns who provide favorable effectiveness ratings 
will be detemined for each index of training provided and presented 

14 



' ' itmnarily in the final report. 

EvaluaClon ObjecCtve ■^4: 

It is axpected that non program supervisor ratings of interni who 
eomplete two thirds of the training program will be favorable on more than 
aiKty pereeat of indlees tailored ipecifieally to program training objectiveg. 

4.1 Subjecti * All non program supervisoty personnel in tehools where 
bilingual interne have been placed* 

4.2 Methods and Procedurei ' A multi^itam rating scale which consists of 
objective and open ended items tailored specifically to the program 
processes affecting school operations will be devised by the evaliiator 
for administration in June 1976 to non program supervisory personnel 
in each school in which bilingual interns have been placed, 

4.3 Data Analysis t Results of supervisor ratings will be analysed and pre- 
sented in both tabular and narrative fora. The percentage of favorable ■ 
effectiveness ratings will be determined for each index of behavior and 
presented simmiarily in the final report* 

Evaluation Objective #5 : Process Objective 

The evaluator will observe.^ progrM activity, conduct interviews and 
examine pertinent records to determine the extent of congruence between, 
original program proposal specifications and actual implementation* these 
data will be included sunmarily in the final report. 

The evaluator will observe activity and interview key personnel to de- 
termine strengths and weaknesses of the program in order to provide recotmend- 
ations for recycling j planning and staff development; these data will be pro- 
vided si^marily in the final report, 
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CHAfTia 111 
FINDINGS 

Evaluatldn Ob^ectiva ^^1 

I£ wai eKpacted chat limited English speaking pupils raaelving bilingual 
laatruction in reading would achieve statlattcally significant growth in read* 
Ing coinprehension as measured by a pre^posttest administration of the Inter* 
Asierlcan Series Reading Testis The targeted pupils were pretested in the 
period October - Deeember»f 1975 with various levels of the Spaniih or English 
versions of the Inter American Reading Series. All pupils were given the test 
In their dominant language* Posttests were admlniitered In May 1976, Thus, 
the gains reported in Table 1 are atfiribabla to a treatment Interval of five 
to six months. Data was analysed separately by grade, test level and language 
with correlated u_ tests. 

As can be seen in the tabled results ^ the overwhelsiing preponderance of 
analyses were statistically significant. Indeed, raost of the very small number 
of Instances of non^slgnlf leant gain can be attributed to small sample sizes. 
Significant growth In reading achievement was achieved on every grade level 
both for Spanish and English dominant youngsters. Since the test levels 
are not well articulated howevers having no cotmon metric^ It is impossible 
to make any comparisons as to the relative degree of success among various 
grades. Thus, in terms of the eKpeetatlons specified, this objective was 
achieved , 
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Evaluation Obiecttve -^2 : \ 

w 

Aaeordlng to thlf. objacclve, It wfls expected that United English-speaking 
pupils would achieve statistically significaQt Improv.^raent in mathematlci achieve^ 
mant as measured b^'a pre-post test admintstrattQn of the Inter-American Series In 
mathematics. Targeted pupils were pretested In the period October - December, 
1975 with various levels of the Inter-American Tests of General Ability and 
Reading and Number. All pupils were given the test In their dominant language. 
Fosctests were administered in May 1976, Thus, gains reported in Table 2 are 
attributable to a five to sijc month treatment interval, ' Data was analyzed for 
statistical significance by dominant language^ grade level and test level with a- 
correlated t_ test* Analysis of the tabled results shows that this objective 
was achieved. On every grade level, irrespective of language, statistically 
significant gains were ■ attained * Indeed , the few instances of non-significant 
growth can be attributed to the very small sample sizes. Since the tests contain 
no common metric between various levels , however , comparisons of relative success 
among various grades are not possible. * 



Evaluation Objective #3 : 

Under this objective, It was expected that at least two-thirds of the bi* 
lingual teacher Interns would provide favorable effectiveness ratings on more 
than sixty (60) percent of indices related to training activities. The evaluator 
developed a questionnaire for teacher interns which provided a three-point rating 
scale on which fifteen (15) separate training activities related to program 

1 — ____ ___________ _____ 

For purposes of setting eKpectatlons for this objective, ratings of c 
and' B were judged to be favorable. Thus, a training activity had to 

enable the intern to achieve moderate success when he applied this 

activity in the classroora situation* 

O 9 1 
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TABLE 2 MTHEMATICS 



Summary Statlstlci of Raw Score Meana , Standard Deviations, and Correlatid c Testi 
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objeettves eould be raced on factors of relevance and if f ecCivenesi . Thisv^ 
qusstlQnnatre was mailed to the homes of eighty (SO) Intemi during the laot 
week of the sehool year in June 1976, Twtnty-three quastlgnnaires yert' re- 
turned to the evaluator In time to he analysed for this report, 

Analyals of the reiponses Indleated one hundred (100) percent of the 
teaeher interns provided favorable ef f ectlveneis ratings on over sixty (60) 
percent of the training activities provided. Thus, this objective was achieved. 

Furtfier analysis showed forty -eight (48) percent of the Interns provided 
very effective ratings to at least sl^ty (60) percent of the training activities 
To provide this rating an Intern must feel that the training enabled her to 
perfora this activity ve^ well In the classroom situation. In the evaluator's 
judgment, this is a most significant Indicator of the quality of training pro* 
vlded''by the Program* 

Almost half the trainee respondents considered themselves able to be highly 
effective In the great majority of teaching activities perforaed during their 
first year in schools suffering radical curtailments of supplies and supportive 
services due to the fiscal crisis in this city. 

T?ble 3 provides a distribution of Intern ratings for each training 
activity on factors of relevance and effectiveness. Analysis shows -hat in 
almost all Instances, Interns perceived the effectiveness and relevance of 
training activities In a highly correlated fashion, inaimuch . as these factors 
are theoretically mutually eiccluslve, this response pattern suggests little 
significance should be placed In comparing distributions of ratings on these 
factors. Apparently, interns perceived these dimensions as virtually Identical 
factors. 

Analysis of the distribution of ratings on effectiveness reveals the 
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TABU! 3| mCffiR/lNTO^ QllSnomm 

DISTRIBtJTION OF THE PERCENTAGES OP RATDJGS OF TRAINING ACTWHIES 
ON FACTORS OF MELEVANffi AND El^ECTIVEMESS (N » 23) 
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training activities judged to be most eff actively implemented. Since every 
training activity was judged favorably in effectiveness by over eighty*five 
(85) percent of respondents indicattng that Interns could at least achteve 
moderate success in implementing the activity in their claairoo®^ attention 
should be focused on the percentages of "C*' ratings provided to obtain any 
degree of discrimination of perforaance among the various training activities. 
Training in developing concrete learning materials was completely success 
ful for seventy-eight (78) percent. of the Interns. Sixty-five (65) percent of 
interns achieved complete success in providing activities to enhance language 
acquisition In Spanish and in English, Sixty-ona (61) percent of interns were 
enabled to very effectively implement procedures in classroom roanagament and 
strategies for teaching reading, creative writing and Caribbean culture, 
Fifty-seven (57) percent were vary effective in providing small group instruc- 
tional activities. Fifty-five (55) percent perceived themselves as capable 
of providing audio-visual instruction in a very competent manner, ^ 

Activities that fewest interns were able to provide in a veiy effective 
manner were use of the paraprof essional (24 Percent) and open classroom tech- 
niques ( 30 percent). In as much as many classrooms were not provided para- 
professional services due to budget constraints on the tax levy program and 
cutbacks in the Title I funding^ many respondents did not have sufficient 
opportunity to test their training ikills in this activity. Similarly, the 
existence of statlonai^, bolted-down desks in many of the inner city classrooms 
to which interns were assigned did not permit the implementation of open 
classroom techniques for many interns. 

Evaluation Ob j active -H i 

Under this objective. It was expected that at least two-thirds of 
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non-progrMi supervisors of the Bilingual Teacher Interms would provide favor- 
2 

able ratings on mere than sixty (60) percent o£ Indices tailored fpeeifically 
to program training activities. The evaluator developed a questionnaire to 
enable the supervisors to rate interns under their supervision an eight pedagp* 
glcal performance activities considered essential to effective teaching by the 
training program. The rating scale provided a five (5) point range o£ response. 
Supervisors were requested to provide each rating relative to the performance 
standard considered typical of first year bilingual teachers. The scale pro- 
vided an option for '^o basis of comparison" If the supervisor had not pre* 
vlously supervised bilingual teachers. A copy of the questionnaire Is provided 
la the Appendix, The questionnaire was mailed to each of the fifty-four (54) 
target schools during the last week of June 1976, Twenty-eight questionnaires 
were returned. This response rate of fifty-two (32) percent, in the evaluator *s 
judgment, Is relatively high and considered representative. Three of the re- 
spondents indicated an Inability to vpi^^vide ratings since they had never before 
supervised a bilingual teacher. 

Analysis of the distribution of ratings provided by respondent supervisors 
Indicates that this objective was achieved, Slxty^eight (68) percent. of respond- 
ents provided favorable ratings oh mare than sixty (60) percent of the performance 
activities considered essential to successful teaching. 

In addition^ eighty-four (84) percent of respondenCi felt that Interns were 

= 2 - - ^ — — . — 

For purposes of evaluating this objective, the criterion of a favorable 
rating was defined as a 4 or 5, Thus, for a rating to be judged favor- 
able, the Intern had to demonstrate at least "above average*' perfortaance 
on the teaching activity 
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■ Xm 4: m PROGRAM SWERVISORS qiSTIONNAIli 

DISTRIBWra OF RATINGS OF imw PERFOKE, BY PERMffiS, 
ON INDIES RSUTED TO TRAINDB OBJECTIVES (N "28), 
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Biethods appropriate to tin nature of tlie subject 
infltter and dealred behavioral goals, 

4, Tilt capacity to plan effectlva lesions that in Chili 
cuniulatlve loipact producs deilrid betiavloral outcfflnji 
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above avsraga ©r iuperior in performing at least half tha performanee activities, 
These non program ratings of the perfoirmance of the Bilingual Teacher Interns 
asaigmed to their schools provide substantial testimony to the quallt^and effect- 
iveness of the three-phase raining pragrain. 

Table 4 provides a distribution of the ratings of the interns in percent- 
ages for each perforaance activity. It can be seen that on the average^ eighty^ 
nine (89) percent of the supervisors perceived the Interns performance across 
all perforaance Indlcatori as at least on a par with the standards expected of 
first year bilingual teachers, Siicty^six (66) percent rated their perforaanca 
across all activities as above average or superior. Thirty-two (32) percent 
rated their total performance as superior. Only three (3) percent of interns 
were given a combtsed rating across all activities as below average. 

Further analysis permits a comparison of the quality of intern performance 
among Che various performance activities. Pooling the ratings of above average 
and superior^ the following percentages of interns were Judged as providing a 
level of performance above the standard rated typical for first year bilingual 
teachers • 

- 85 percent exceeded the average on the auallty of their interaction 
with parents of targeted pupils 

- 74 percent exceeded the average in the ability to transmit aensitivity 
and awareness of the emotional and learning needs of their pupils 

- 70 percent e^sceeded the average in cooperation and articulation with 
other pedagogical staff - teacher and supervisors 

67 percent exceeded the average in their capacity to provide a variety 
of learning activities and modes of instruction to pupils 

63 percent exceeded the average in their ability to use a variety of 
bilingual teaching methods appropriate to the subject matter and desired 
pupil behaviors 



- 59 parcenc exceeded the average tn their demonstrated abtllty to 
develop bllttigual matarlal to concretize concepts ernbodted tn 
lesson alms 

- 58 percent excaeded the average in their capacity to perform admin- 
istrative asslgnTOents In an efficient manner 

- 55 percent exceeded the average in their damonstrated capacity to 
plan effective lessons 

Evaluation Qbiectlve #5 

According to this objective, the evaluator was required to observe progam 
activity, conduct interviews and examine pertinent records to deteraine the 
extent of congruence between original proposal speciflcationi and actual to* 
plementation It also required the evaluator to tntervtew key personnel to 
determine program strengths and weaknesses to obtain recoTOendations for re- 
cycling. 

Based upon nuffierous visits to various sites of program activity^ observa- 
tions and tnterviews with program and nan program pnrsonnel, there were no sub- 
stantial discrepancies between the proposed program p id Its tmplemantation. The 
following observations can be made* 

1* Target Population * The program provided services for 2499 pupils 
rather than the originally anticipated 3000, This was a necessary 
concomitant of a variety of correlated factors foremost being increased 
tuition at C.U.N,Y that reduced the number of interns that could be 
accepted from 100 to 80 and altered class sizes which had Increased 
due to the New York City fiscal crisis and subsequent budget cuts* The 
population was ^ substantially as targeted,- Each Intern had a class, 
register consisting of pupils to whom he/she adralniitared pragram 
developed Instruments to assess level of dominant language. Through 
the asslst-a^e of workshop training and the teacher trainers in the 
field, each Intern evaluated the results of the language assess- 



ment. On the basis of these findings, the apprDpriate leveU ©£ the 
C.I. A. series were administered as a pretast In Novembar 1975. 

2. Tasting i The only devtation from the proposal observed was the late 
administration of the pretest. This was caused by the protracted 
fiscal drisls and contract negotiations that resulted In a teacher 
striks. Exeesslng of teachers, continuous re-organiitng of clasieSj 
and other associated factors did not permit the program to IsplaiDent 
the pretest deslpi as originally scheduled. When claises stabilised 
toward the end of October , the program was able to complete its pre** 
Itminary assessment of pupils' level of dominant language In order 
to validly administer the correct levels of Habllldad General and 
Frueba de Lectura (CI. A, Series), The evaluator feels that the pro- 
gram performed extraordinarily well under adverse circumstances In 
securing valid pretest data on the target population by November 1975, 
particularly In light of the fact that the administration had to be 
accomplished In eleven separate school districts by 80 Interns, 

3- Sites I The number of school sites In which Interns have been placed 
differed slightly from the original plan although no precise figures 
could he drawn In advance* The proposal anticipated placement In 5-8 
districts rather than 11, With only 3 teacher trainers, optimum condi- 
tions would have consisted of a tighter configuration of sites with more 
Interna placed In fewer districts in schools with greater geographic 
proximity. This was not possible. Reduced budgets of districts that 
had contracted agreements with the Project Director did not permit the 
absorption of the number of interns originally desired* Commitments 
to expanding bilingual education In these districts had to be limited 
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Ill the face of massivi teacher axceising. However, other dtitricta, 
because of the need to tmplement the mandate of the ASPIEA Consent 
Decree, coatracted with the progrim for pUcement of the remaining interns. 

Training and Workshops i An essential part of the Bilingual Intern 
Program was the integracad three-phaie training prograia provided. All 
interns attended the Graduate School of Education at City Univeriity of 
New York (C,U,N,Y,)' Each intern .completed nine credits in bilin^al 
education leading to a masters degree. Interns attended C.U,N,Y. one day 
per week either on. Tuesday or Wednesday, On Thursdays ^ Interns attended 
tn*aervice workshops txm by the Project Director and her staff, "nieae 
workshop training sessions were integrated with the C,U,N,Y* graduate 
program and with problems that arose within the context of elasaroom 
assigraents in the school setting. Training staff, having observed on 
a first hand basis the performance of each Intern in the classroom setting 
as well as the content and quality of interaction in the graduate school 
program, were able to integrate theory and practice into the in-service 
training workshops to meet the most keenly felt needs of the interns. The 
program developed a sophisticated mechanism to eKpose all interns to each 
phase of training on a rotating as well as elective basts. Each teacher 
trainer was responsible for a module of instruction baaed upon individual 
expertise and preference in subject matter. These modules operated con* 
currently enabling interns to participate in all three on a rotating basis 
as the modules re-cycled. Instruction proceeded from the theoretical to 
the concrete articulating the understandings and problems gleaned from ^ 
classroota settings on the Job as wall as In graduate school. Strong 
emphasis was placed on developing concrete teaching-learning devices from 
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tvaryday Mteriala. The evaluacor ©bierved the creation ©f a variety 
of games useful in motivating ehildran to praetiee the concepts learned 
la ciaaa. The devicei ware frequently adaptable Co. dlf faring content 
and leveia of instruction* In addition, interns developed a variety of 
eonerete devlcea deaigned to demonstrate seience and mathematiea concepti 
la the claasroom. Theae projecta provided a vehicle for developing a 
series of leasona by each Intern and proved uaeful in atimulattng a hoat 
of ideaa by the ohildren. As the program unfolded , each intern created 
a ntsiber of concrete produeti that served to enhance the quality of teach- 
ing as well aa the claaaroom learning environment* 

The project arranged ta maKimise its effectiveness by coordinating 
Its graduate school and workshop opportunities with a number of aeparately 
funded projecta throughout the city. Among the opportunities provided for 
articulation with other projecta on an elective basis were* 

three workshops in curriculum ae lection and utilisation 
sponaored by the Regional Cross Cultural Training and 
Resource Center 

* Three aeaaians of Lillian Weber 'a Open Education Workshop 
at C.U,N,Y. 

* an ongoing project with the New York University City Science 
Program 

This latter program attracted 20 bilingual Interns who iubmitted a number 
of projects for eKhibit, The success of theae levels of training was ob- 
s erved in field obaervatlons of the Interns and teacher trainera where 
projects stimulated in workahopa w^re implemented in the classroom with 
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children parttclpaclng. The arrival of Che teacher traioer was often 
heralded by the children as they welcomed the oppartunlty to show off 
the progr .as they had nade. The program 'a Eratnlng mechanisms were well 
articulated, providing a continuous feed -back loop for adjustment and 
new input. 

Stait t The program consisted of the same staff as outlined in the project 
proposal. Each staff member was observed performing Jobs in aecordanca 
with the program proposal. However, there was a need for an additional 
teacher trainer. The 27a ratio of Interns to trainars frequently result* 
ad in extensive delays between field vistti. The Interval between class- 
room visits was often too long to provide the necessary Impact and reinforce 
ment of training suggestions for improvement. This was particularly true 
for less gifted Interns who were frequently functioning in schools with 
little supportive servlec. 



36 



(28) 
CMPTER IV 

SmmJRY OF MAJOR FINDING AND CONCLUSIONS 

On the bails of tha findingf of this report, it is concluded that all 
four major evaluation objectives were aehleved. As expected under evaluation 
objectlvei 1 and 2, targeted pupils in elassroomi of participating ichools 
where Bilingual Teacher Interns were placed achieved itatlstioally iignificant 
gains In reading and mathematics. These gains were achieved regardless of 
the language of the Inter American Series tests used and registered over a 
six month pretest-poittest interval. 

The growth demonstrated probably underestimates the impact of the treat- 
ment through no fault of the progrm. Had the fiscal crisis^ budget cuts, 
teacher strike and consequent disorder not delayed the Implementation of the 
testing plan, Che gains achieved would have likely been even greater. 

EKpectatlons. for objective 3 and 4 were also attained. Under evaluation 
objective 3, two thirds of the interns were expected to a.-hieve at least 
TOderate success in implementing at least ,slKty percent of program training 
activities. One hundred percent of interns responded favorably on this 
criterion. In addition almost half the interns rated themselves as highly 
effective in the majority of teaching activities perfonned* 

For evaluation objective 4, the expectation at at least two thirds of 
non program supervisors wuld rate interns under their supervision as more 
effective than typical beginning bilingual teachers on at least sixty percent 
of the performance indices related to progrm training objectives was achieved* 
Sixty eight percent of nonprogram supervisors- ratings met this criterion. 
In addition, 84 percent of supervisors thou|;ht that Intern performance was 
above average or superior on a majority of perforaance Indices. 

On the basis of observations and interviews, the evaluator concludes 
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that thm pragram ^ai implementid iubstantially ae propoied. No raajor 
deviations ^ere observed in ntjmbae af targaced pupllg, deployment of staff, 
□paration in participating iitas, tesclng ow training prQeadures were ob- 
served. Variation in placement af intarns and testing schedulas resulted 
from factors bayond the control af the Project Director, Thaae deviacions 
accurrad in response to the N,Y,a. fiscal crisis and budgat cuts that causad 
widaspread disruption in the programs of participacing schools. 

On tha basis of thesa findings it is concluded that tha program was 
extramaly affactiva* Tha achievamants mat tha objactivai of both 
tha pra gram proposal and the avaluation design* In particular the following 
observations and conclusions are drawni 

, Project staff assignaents and responsibilities were claarly 
delineated and implementad, 

# Screening and avaluation of pupils was CD.iiu«tid by prajact staff* 

* Xhare was a wide range of learning and teaching 
strategias to achieva cognitive and ^^iki^^ti:^^ abjactives* 

, In-servica training was iaraprahensiva and thorQugh, Non 
progrM personnel at projact targated schools were favorably 
ispressed* 

• Parental invoivament was implemanted successfully, P/iranta work- 
shops were provided in sevaral cooperating diatriata by the 
Project Director and teacher trainers* In addition. Parent 
Advisory Comittaas wera fomad In several districts. The form* 
ulation of a Intern Advisory Council provided a aucQesaful machanism 
for rasponding to parent participation ntti^ throughout the eleven 
cooparating districts, 

• Field training and curriculum davelopm,a'-*f v-rrs well integrated 
via in-aarvica training workshops at <:he blj.ingual resource cencer 
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and tht graduate ichool componaat. Staff wae able to increase 
their taaching strategias and develop innovative approaches* 
« Cultural heritage activities, wherein Spanish dominanc and 
English dominant pupils received coTOblned Instruction resulted 
in a growing mutual respect and Interegt In each other's cultural 
backgrounda p The enrichraent provided opportunities for the 
project to interact favorably with regular personnel and provided 
a mechanism for increased parental Involvement, Inhanced comiun* 
Ity relations were created through thii component of Initruction* 
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RECOMHENDATIONS 

On the basis oi the findings. It is recomiended that thii program be 
CQntlnued* The following reeommendationt are based on nmerous observations 
Interviews and ilte visits condueted by the evmluaCor throughout the program 

1. The prograca should be expanded to provide a seeond year of 
eKpOiure, on a reduced basis* to this year's group of interns. 
Without benefit of the program-s organizational skills for pro- 
viding opportunities for parttelpation in workshop aotivlties 
eonduoted by various professional organiiattons and ouside agencies 
devoted to aross-cultural and bilingual education the growth exhibit- 
ed by these new teaohers might be sharply curtailed* This second 
year of reduced training should be prtnetpally provided through a 
series of mini-workshops with considerable opportunity for "hands- 
on" experience to enhance articulation between graduate school 

, . training and the classroom experience. The incoming group of 
bilingual interns should receive the same full services that the 
program provided thii year, 

2. The program should be funded for additional staff to enhance the 
services provided to first year interns* Another teacher tTrainer 
and clerk/typist should be provided* The caseload ration of 27 il 
maintained by the three teacher trainers/f laid counselors was too 
large* Maintenance of the quality of service necessary to meet 
program objectives was accomplished by a Eealous staff that worked 
many days of unpaid overtime* A teacher to trainer ratio no greater 
than 20 !l should be maintained. In addition program workload re- . 
quires another clerk/typist to provide full service within the 

normal working dav, . « 

40 



Tha program should arrange to place interns in schools within a greater 

giographical proximity to one another* The participating sehdols, 

in eleven coEmunity ichool districts are too far apart to 

praperly service without exceisive strain on the staff* Travel 

time to varioui far-flung locations detracts from the usable 

time training staff ia able to provide interns, parents and 

ragtilar bilingual staff requesting service. The consequent 

effort reqiiired to meet increased demand dissipates the quality 

of service that tbe progrMi is capable of providing* 

The modular approach developed for the second semester's training 

workshop was perceived by interns as an improvement* Interns 

felt a greater sense of participation and were able to assume 

mare positive roles of leadership within the rotating framework 

provided in the small group TOdulariEed structure* This 

practice should be implemented over the cour^af the full year's 

training workshop* It affords interns a greater sense of control 

of events and stimulates a more creative eKchange of ideas. 

The mini*workshop opportunities arranged by the program with 

other outside agencies seeking to explore bilingual education was 

perceived as a highlight by many of the interns* These workshops 

provided"hands-on" in depth experiences that were very stimulating 

to the intern "S professional growth* The program should continue 

to eKpand in this direction seeking Increased articulation with 

other organizations possessing a commonality of interestis. 

The testing program would be canslderably Improved if local norms 

could be provided for the tests used. The Central program should 

consider formulating a proposal to obtain Title VII funds to norm the 
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Intey Aaerican Sariea raading tests for loeml use. Inasmueh as 
a niffiiber ©f pTOgtBmn «a rscaiving fundiiig uadar Title VII for 
similar treatment of target puplla, an tffort ihould be mada Co 
acquire the basis for a TOra precise estimate of the ef feet of 
treatment by providing a meahanism to astimata pupil performanei 



AFflNDIX A 
BlLINGUAi TlACIffiR/lOTERN QtESTlONNAIKE 



ERIC 
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lOAMO sr soueATio^ new york 

□FFICS ar EDUCATlONAL^ALUATinN 



(212) 596-6146 



ANTHSNY J. PQUfMSNl. PH,Q. 

mmmmm 



Jvmm 22, 1976 



Saar Ladies and G^ntl^mnt 

May we request jow esaperatlen is assistini thla afflea In 
coaduetlag a maadated e^aluacioa ©f The Blliagual Intera PTSgram 
funded uader Tl^le 711 tor the If 75 '76 sehaol year? 

In order t© IspleMnC one of^the atijeetives of thii evaluation * 
it is required that pro^M teaeher-interns rate salee ted trainlnf 
activities provided through Graduate School* weekly Froirra workshop 
and field visits by teaeher trainers on two diBensions: relevancy 
and effectiveness. 

Please fill out the enclosed questionnaire consisting of a 
represencatlve sample of training activities and return it to this 
office as soon as possible via the self addressed, st^isped envelope 
enclosed. 




Sincerely yours » 



mtlh 
Enci 



Wlllia 8i 
Ivaluator 




ERLC 



Belw are listad a- variety of activities eacompassed within 
progrMa training objectives. Axl tmderstanding of the techniques 
and methodologies ■underlylni these performance activities are 
considered essential to successful bilingual teaching. Tor each 
activitx Indlcatad, pleas* rata the degree of relevance to your 
teaching situation by circling one of the numbers from 1 to 3 
in accordance with the scale provided- nien indicate the degree 
of effectiveness of the" training provided by circling one' of the 
letters A through 0, Please provide a reason for toy extreme' 
negative or posiclve rating in. the space provided. ■ 



Extent of Relevance of Training ' Effectiveness of Training 



3 


Extremely relevant to 
teaching performance 


G 


-- " T •_ . _ — — ^ - R- .... — _- -- " 

Vary gffaatly^a-enafalad> ma^^^^ ; 
^ ^parioCT activity wall, ' 


2 


Moderately relevant:" 
to ^taaehxng psrforaanea 




itodairat#ly e£f aotl^y^t-enablad 
me to p«vld5:^partiall^ 
aueesa a ful activity, ' 


1 


Not prkatileal-lltCle 
or no ralsv^ee to 
my teaching situation 




Little or no ef£aat-did not 
pMvide sufficlant knowledge 
to Miploy this aativity 
suoeasaf ully . 


1. 


GlaasroQm managama^t 
Raason: 




1^2 3 ABC 










2. 


Use of the paraprofessionaL 
Reason r 




1 2 3 A B C 



3. Open classroom techniques 
Reason t 



12 3 



ABC 



4-.. Individual ad instruction 
Eeaaoni 



12 3 ABC 



5, Small group instruction , 1 2 3 A B C 

Raason: 



6. DiapiQaing languEgs handicaps 12 3 ABC 

Raasen: 



i\ Stratagies to mnhanca lan^age aoquisition 

(Spanish)^ 1 2 3 A B C 



Raason; 



8. Stratagies to anhanea language acquiaition 

(English) . 1 2 3 A B C 



Raason: 



9. Tachniques in davaloping leaaon plans 12 3 ABC 

Reason: 



10. Tac^iquea in davaloping aonerata learning 

\ materials 1 2 3 A B C 



Reason: 



11 • Oparation of audio- visual hardware and^ soft- 

12,3 ABC 

Reason I 



12. StTategits £oir Ceaahing mathematics 



12 3 



ABC 




12 3 



ABC 



Eaaaon: 



14. Stratagias for teaehlng Science 



12 3 



ABC 



Reason: 



15. Strategies for teacMng Caribbean Culture 
and History 

Reason: 



16^ What are the most important Espeota of the 
program which contribute to iuccesa? 



17. Wiat are the most inhibitory factors in the 
cotirse of your program? 



18. ^at are your planning reconmendations .for the 
comng year in this program? 



ERIC 
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SUFERVISORS QUISTIONNAIRE 
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is4^R0 or eDusATiaN qf the city op Nr^v yomk 
□ PFIGE OF EDUCATiaNAL EVALUATIDN 
HQ UVlNSSraN street. ISaQiCLYN. N. Y. 

(212) 596-6146 



ANTMQNY J, PSLEHEHi 



PH.D. 



June 22, 1976 



RigHAflS T, TURNC^- PH.D. 



Bear Lmdlei and Cant 1 amen i 

May wa requaic yaur e©aparatton in aasisting thli efflca 
whleh is rasponiiblt for eondueeing an avaluaclon of thm Bilingual 
Intern Pragris fundtd under Titla VII far the lf75*76^ school year? 

In order to impleasnt one of the objeatives of this evaluation^ 
it is required that non pregrM iuparvisors rate seleeted taaahing 
aetivitles of the bilingual Interna asaign^d to their sehool. These 
performanoe activities are keyed to progrM training objectives and 
are repreaantative of the craulativa training prDVided throughout 
the year in graduate school and weekly program warkshops. 



Please fill out the enclosed questionnaire and return it in 
the self addressed s stamped envelope as soon as possible* 




49 



• - fiiLXNGUAL - INTERN PROGRAM^' EVALUATION , ■ " 

= ■ i . . - « - --- ■: , 

NASffi >0F RESPONDENT ~^ SCHOOL 

SUPER^;iSQRS QUESTION^IAIHE 



Listed balow are various padagagiaal beriaviors intagral to 
effeati^a taaQher parformanaa* Bilingual teachar interns have 
racalved intensive training to arfianee performance in eaeh q£ 
these, aatlvitias via weekly ^orksheps and field trailing saasions 
eondtiatad hy pra^m parsoimel* Using the seala provtdedi pleasa 
rate teacher intera performance on each activity pr as anted in 
comparison to the parformanca lavel of other beginning btlinpial 
teachers midar yonr supervision by circling ^ one 'of the nu^ars 

2 3 4 1 



from 1 to 5, 
1 



No basis of 
comparison , 
no other 
new bilin- 
gual . . 
teachers 
under my 
supervisior 



Below 
-average J , 
performance 
not as 
effective 
as general- 
ly e^chib- 
ited by 
beginning 
bilingual 
teachers . 



Average , 
performance 
about the ^ 
same as 
demonstrated 
by typical 
beginning 
bilingtial 
teachers , 



Above 
Average^ 
behavior 
exhibited 
slightly 
more^ effec 
tive then 
character- 
istic of 
typical 
beglmiing 
bilingual 
teachers . 



Superior, 

considerably 

more effective 

perforaance 

than typically 

observed 

from beginning 

bilingual 

teachers , 



The ability to transmit sensitivity and awareness 

of emotional and learning needs of children, 1 2 3 4 5 

Eeaaont ' ^ ^ ' 



2. The capacity to provide a variety of learning 

activities including differant modes of instruction 

favorable to maintenance of good pupil motivation 

and morale, .12 3 4 5 



Reason : 
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3, = The ability to use a variety of bilingual taaching 
\ . msthodi appropriata to the nature of the sub j set 

matter and desired behavioral goals, 1 2 3 4 5 

Raasom 



4. Thm capaaity to plan afftetive lessons that in 

th#ir etmulative impaot produoe desired behavipral 

outcomes . 12 3 4 5 

Reason: 



The ability ^to develop bilingual teaoher made 

materials to oonarati^a coneetDts embodied in lesson 

aims. . ' 12 3 4 5 



Reason: 



6* The ability to eooparate and artioulate with other 
pedagogical staff including taachers and supervisors* 

1 2 3 4- 5 

Reason r 



7^ The capacity" to perform a^inistrative tasks 

assigned in an efficient manner, ^ 12 3 4 5 

Reason: 



8* The capacity to ralata to parents and effectively 
elicit cQoperative effort in providing reinforce- 
ment of desired pupil behaviors. - 12 3 4 5 

Reason : 
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